Hybrid Eye Tracking: Combining Iris Contour and Corneal Imaging

Passive eye-pose estimation methods that recover the eye-pose from natural images generally suffer from low accuracy, the result of a static eye model, and the recovery of the eye model from the estimated iris contour. Active eye-pose estimation methods use precisely calibrated light sources to estimate a user specific eye-model. These methods recover an accurate eye-pose at the cost of complex setups and additional hardware. A common application of eye-pose estimation is the recovery of the point-of-gaze (PoG) given a 3D model of the scene. We propose a novel method that exploits this 3D model to recover the eye-pose and the corresponding PoG from natural images. Our hybrid approach combines active and passive eye-pose estimation methods to recover an accurate eye-pose from natural images. We track the corneal reflection of the scene to estimate an accurate position of the eye and then determine its orientation. The positional constraint allows us to estimate user specific eye-model parameters and improve the orientation estimation. We compare our method with standard iris-contour tracking and show that our method is more robust and accurate than eye-pose estimation from the detected iris with a static iris size. Accurate passive eye-pose and PoG estimation allows users to naturally interact with the scene, e.g., augmented reality content, without the use of infra-red light sources.